42 research outputs found

    A stacked LSTM based approach for reducing semantic pose estimation error

    Get PDF
    © 1963-2012 IEEE. Achieving high estimation accuracy is significant for semantic simultaneous localization and mapping (SLAM) tasks. Yet, the estimation process is vulnerable to several sources of error, including limitations of the instruments used to perceive the environment, shortcomings of the employed algorithm, environmental conditions, or other unpredictable noise. In this article, a novel stacked long short-term memory (LSTM)-based error reduction approach is developed to enhance the accuracy of semantic SLAM in presence of such error sources. Training and testing data sets were constructed through simulated and real-time experiments. The effectiveness of the proposed approach was demonstrated by its ability to capture and reduce semantic SLAM estimation errors in training and testing data sets. Quantitative performance measurement was carried out using the absolute trajectory error (ATE) metric. The proposed approach was compared with vanilla and bidirectional LSTM networks, shallow and deep neural networks, and support vector machines. The proposed approach outperforms all other structures and was able to significantly improve the accuracy of semantic SLAM. To further verify the applicability of the proposed approach, it was tested on real-time sequences from the TUM RGB-D data set, where it was able to improve the estimated trajectories

    Neuromorphic Camera Denoising using Graph Neural Network-driven Transformers

    Full text link
    Neuromorphic vision is a bio-inspired technology that has triggered a paradigm shift in the computer-vision community and is serving as a key-enabler for a multitude of applications. This technology has offered significant advantages including reduced power consumption, reduced processing needs, and communication speed-ups. However, neuromorphic cameras suffer from significant amounts of measurement noise. This noise deteriorates the performance of neuromorphic event-based perception and navigation algorithms. In this paper, we propose a novel noise filtration algorithm to eliminate events which do not represent real log-intensity variations in the observed scene. We employ a Graph Neural Network (GNN)-driven transformer algorithm, called GNN-Transformer, to classify every active event pixel in the raw stream into real-log intensity variation or noise. Within the GNN, a message-passing framework, called EventConv, is carried out to reflect the spatiotemporal correlation among the events, while preserving their asynchronous nature. We also introduce the Known-object Ground-Truth Labeling (KoGTL) approach for generating approximate ground truth labels of event streams under various illumination conditions. KoGTL is used to generate labeled datasets, from experiments recorded in chalenging lighting conditions. These datasets are used to train and extensively test our proposed algorithm. When tested on unseen datasets, the proposed algorithm outperforms existing methods by 8.8% in terms of filtration accuracy. Additional tests are also conducted on publicly available datasets to demonstrate the generalization capabilities of the proposed algorithm in the presence of illumination variations and different motion dynamics. Compared to existing solutions, qualitative results verified the superior capability of the proposed algorithm to eliminate noise while preserving meaningful scene events

    Design of Dynamics Invariant LSTM for Touch Based Human-UAV Interaction Detection

    Full text link
    The field of Unmanned Aerial Vehicles (UAVs) has reached a high level of maturity in the last few years. Hence, bringing such platforms from closed labs, to day-to-day interactions with humans is important for commercialization of UAVs. One particular human-UAV scenario of interest for this paper is the payload handover scheme, where a UAV hands over a payload to a human upon their request. In this scope, this paper presents a novel real-time human-UAV interaction detection approach, where Long short-term memory (LSTM) based neural network is developed to detect state profiles resulting from human interaction dynamics. A novel data pre-processing technique is presented; this technique leverages estimated process parameters of training and testing UAVs to build dynamics invariant testing data. The proposed detection algorithm is lightweight and thus can be deployed in real-time using off the shelf UAV platforms; in addition, it depends solely on inertial and position measurements present on any classical UAV platform. The proposed approach is demonstrated on a payload handover task between multirotor UAVs and humans. Training and testing data were collected using real-time experiments. The detection approach has achieved an accuracy of 96\%, giving no false positives even in the presence of external wind disturbances, and when deployed and tested on two different UAVs.Comment: 13 pages, 13 figures, submitted to IEEE access, A supplementary video for the work presented in this paper can be accessed from https://youtu.be/29N_OXBl1m

    Pose-graph neural network classifier for global optimality prediction in 2D SLAM

    Get PDF
    The ability to decide if a solution to a pose-graph problem is globally optimal is of high significance for safety-critical applications. Converging to a local-minimum may result in severe estimation errors along the estimated trajectory. In this paper, we propose a graph neural network based on a novel implementation of a graph convolutional-like layer, called PoseConv, to perform classification of pose-graphs as optimal or sub-optimal. The operation of PoseConv required incorporating a new node feature, referred to as cost, to hold the information that the nodes will communicate. A training and testing dataset was generated based on publicly available bench-marking pose-graphs. The neural classifier is then trained and extensively tested on several subsets of the pose-graph samples in the dataset. Testing results have proven the model's capability to perform classification with 92 - 98% accuracy, for the different partitions of the training and testing dataset. In addition, the model was able to generalize to previously unseen variants of pose-graphs in the training dataset. Our method trades a small amount of accuracy for a large improvement in processing time. This makes it faster than other existing methods by up-to three orders of magnitude, which could be of paramount importance when using computationally-limited robots overseen by human operators

    Macro and nano dimensional plant fiber reinforcements for Cementitious Composites

    Get PDF
    uncorrected proofNowadays, the use of plant fibers in the civil construction industry is growing rapidly due to their low cost, light weight and good specific mechanical properties, lower health hazard, and environmental benefits. Nanodimensional fibers derived from plants such as nanocellulose are also getting considerable attention due to their excellent mechanical properties. This chapter discusses these different types of plant fibers and their derivatives which have huge application potential in the civil construction sector. The influence of plant fibers on microstructure as well as on physical–mechanical properties of cementitious composites are discussed in detail. The challenges regarding plant fiber processing and dispersion, the fiber/matrix interface, and the durability of plant fiber-cement composites are also addressed. The application of nanocellulose in polymer composites has been included in this chapter just to provide the readers sufficient background information and techniques to inspire engineered cement-based composites. Finally, the chapter concludes with the current application of plant fibers in civil construction and the future trends(undefined)info:eu-repo/semantics/publishedVersio

    Consumer Adoption of Self-Service Technologies in the Context of the Jordanian Banking Industry: Examining the Moderating Role of Channel Types

    Get PDF
    YesThis study aimed to examine the key factors predicting Jordanian consumers’ intentions and usage of three types of self-service banking technologies. This study also sought to test if the impacts of these main predictors could be moderated by channel type. This study proposed a conceptual model by integrating factors from the unified theory of acceptance and use of technology (UTAUT), along with perceived risk. The required data were collected from a convenience sample of Jordanian banking customers using a survey questionnaire. The statistical results strongly support the significant influence of performance expectancy, social influence, and perceived risk on customer intentions for the three types of SSTs examined. The results of the X2 differences test also indicate that there are significant differences in the influence of the main predictors due to the moderating effect of channel type. One of the key contributions of this study is that three types of SSTs were tested in a single study, which had not been done before, leading to the identification of the factors common to all three types, as well as the salient factors unique to each type

    Twelve-month observational study of children with cancer in 41 countries during the COVID-19 pandemic

    Get PDF
    Introduction Childhood cancer is a leading cause of death. It is unclear whether the COVID-19 pandemic has impacted childhood cancer mortality. In this study, we aimed to establish all-cause mortality rates for childhood cancers during the COVID-19 pandemic and determine the factors associated with mortality. Methods Prospective cohort study in 109 institutions in 41 countries. Inclusion criteria: children <18 years who were newly diagnosed with or undergoing active treatment for acute lymphoblastic leukaemia, non-Hodgkin's lymphoma, Hodgkin lymphoma, retinoblastoma, Wilms tumour, glioma, osteosarcoma, Ewing sarcoma, rhabdomyosarcoma, medulloblastoma and neuroblastoma. Of 2327 cases, 2118 patients were included in the study. The primary outcome measure was all-cause mortality at 30 days, 90 days and 12 months. Results All-cause mortality was 3.4% (n=71/2084) at 30-day follow-up, 5.7% (n=113/1969) at 90-day follow-up and 13.0% (n=206/1581) at 12-month follow-up. The median time from diagnosis to multidisciplinary team (MDT) plan was longest in low-income countries (7 days, IQR 3-11). Multivariable analysis revealed several factors associated with 12-month mortality, including low-income (OR 6.99 (95% CI 2.49 to 19.68); p<0.001), lower middle income (OR 3.32 (95% CI 1.96 to 5.61); p<0.001) and upper middle income (OR 3.49 (95% CI 2.02 to 6.03); p<0.001) country status and chemotherapy (OR 0.55 (95% CI 0.36 to 0.86); p=0.008) and immunotherapy (OR 0.27 (95% CI 0.08 to 0.91); p=0.035) within 30 days from MDT plan. Multivariable analysis revealed laboratory-confirmed SARS-CoV-2 infection (OR 5.33 (95% CI 1.19 to 23.84); p=0.029) was associated with 30-day mortality. Conclusions Children with cancer are more likely to die within 30 days if infected with SARS-CoV-2. However, timely treatment reduced odds of death. This report provides crucial information to balance the benefits of providing anticancer therapy against the risks of SARS-CoV-2 infection in children with cancer

    Co-infection and ICU-acquired infection in COIVD-19 ICU patients: a secondary analysis of the UNITE-COVID data set

    Get PDF
    Background: The COVID-19 pandemic presented major challenges for critical care facilities worldwide. Infections which develop alongside or subsequent to viral pneumonitis are a challenge under sporadic and pandemic conditions; however, data have suggested that patterns of these differ between COVID-19 and other viral pneumonitides. This secondary analysis aimed to explore patterns of co-infection and intensive care unit-acquired infections (ICU-AI) and the relationship to use of corticosteroids in a large, international cohort of critically ill COVID-19 patients.Methods: This is a multicenter, international, observational study, including adult patients with PCR-confirmed COVID-19 diagnosis admitted to ICUs at the peak of wave one of COVID-19 (February 15th to May 15th, 2020). Data collected included investigator-assessed co-infection at ICU admission, infection acquired in ICU, infection with multi-drug resistant organisms (MDRO) and antibiotic use. Frequencies were compared by Pearson's Chi-squared and continuous variables by Mann-Whitney U test. Propensity score matching for variables associated with ICU-acquired infection was undertaken using R library MatchIT using the "full" matching method.Results: Data were available from 4994 patients. Bacterial co-infection at admission was detected in 716 patients (14%), whilst 85% of patients received antibiotics at that stage. ICU-AI developed in 2715 (54%). The most common ICU-AI was bacterial pneumonia (44% of infections), whilst 9% of patients developed fungal pneumonia; 25% of infections involved MDRO. Patients developing infections in ICU had greater antimicrobial exposure than those without such infections. Incident density (ICU-AI per 1000 ICU days) was in considerable excess of reports from pre-pandemic surveillance. Corticosteroid use was heterogenous between ICUs. In univariate analysis, 58% of patients receiving corticosteroids and 43% of those not receiving steroids developed ICU-AI. Adjusting for potential confounders in the propensity-matched cohort, 71% of patients receiving corticosteroids developed ICU-AI vs 52% of those not receiving corticosteroids. Duration of corticosteroid therapy was also associated with development of ICU-AI and infection with an MDRO.Conclusions: In patients with severe COVID-19 in the first wave, co-infection at admission to ICU was relatively rare but antibiotic use was in substantial excess to that indication. ICU-AI were common and were significantly associated with use of corticosteroids

    Clinical and organizational factors associated with mortality during the peak of first COVID-19 wave: the global UNITE-COVID study

    Get PDF
    Purpose: To accommodate the unprecedented number of critically ill patients with pneumonia caused by coronavirus disease 2019 (COVID-19) expansion of the capacity of intensive care unit (ICU) to clinical areas not previously used for critical care was necessary. We describe the global burden of COVID-19 admissions and the clinical and organizational characteristics associated with outcomes in critically ill COVID-19 patients. Methods: Multicenter, international, point prevalence study, including adult patients with SARS-CoV-2 infection confirmed by polymerase chain reaction (PCR) and a diagnosis of COVID-19 admitted to ICU between February 15th and May 15th, 2020. Results: 4994 patients from 280 ICUs in 46 countries were included. Included ICUs increased their total capacity from 4931 to 7630 beds, deploying personnel from other areas. Overall, 1986 (39.8%) patients were admitted to surge capacity beds. Invasive ventilation at admission was present in 2325 (46.5%) patients and was required during ICU stay in 85.8% of patients. 60-day mortality was 33.9% (IQR across units: 20%–50%) and ICU mortality 32.7%. Older age, invasive mechanical ventilation, and acute kidney injury (AKI) were associated with increased mortality. These associations were also confirmed specifically in mechanically ventilated patients. Admission to surge capacity beds was not associated with mortality, even after controlling for other factors. Conclusions: ICUs responded to the increase in COVID-19 patients by increasing bed availability and staff, admitting up to 40% of patients in surge capacity beds. Although mortality in this population was high, admission to a surge capacity bed was not associated with increased mortality. Older age, invasive mechanical ventilation, and AKI were identified as the strongest predictors of mortality
    corecore